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Abstract 

The models of statistical physics used to study collective phenomena in some interdisciplinary 
contexts, such as social dynamics and opinion spreading, do not consider the effects of the memory 
on individual decision processes. On the contrary, in the Naming Game, a recently proposed 
model of Language formation, each agent chooses a particular state, or opinion, by means of a 
memory-based negotiation process, during which a variable number of states is collected and kept 
in memory. In this perspective, the statistical features of the number of states collected by the 
agents becomes a relevant quantity to understand the dynamics of the model, and the influence 
of topological properties on memory-based models. By means of a master equation approach, 
we analyze the internal agent dynamics of Naming Game in populations embedded on networks, 
finding that it strongly depends on very general topological properties of the system (e.g. average 
and fluctuations of the degree). However, the influence of topological properties on the microscopic 
individual dynamics is a general phenomenon that should characterize all those social interactions 
that can be modeled by memory-based negotiation processes. 
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I. INTRODUCTION 



Language Games are a class of simple models of population dynamics conceived to repro- 
duce the processes involved in linguistic pattern formation inside a population of individu- 
als . They have been profitably used in order to understand the origin and the evolution 
of language |3[, and have found an important field of application in Artificial Intelligence, 
where the ultimate goal consists in modeling the self-organized collective learning processes 
in populations of artificial agents 0,0]. Recently, on the basis of these ingredients, a model 
called Naming Game has been put forward as a simple example of collective dynamics lead- 
ing to the self-organized emergence of a communication system (i.e. linguistic conventions) 
in a population of interacting agents 0, Q]. The original definition of the model considers 
a population of agents that assign names to an object, trying to agree on a unique shared 
name by means of pairwise negotiations. The Naming Game may be applied to different 
contexts. For instance, it may be used to model the opinion spreading in a population of 
individuals that interact by means of negotiation, rather than imitation (as in the Voter 

n 

model |8[). The concepts of memory and feedback on which the Naming Game is based are 
quite new in social dynamics and in statistical mechanics as well. They are at the origin of 
very interesting dynamical properties, some of them have motivated the present work. In 
particular, we will focus on the role of agents' memory, by means of which an agent can 
store several different states (or words, opinions, etc.) at the same time. The aim of this 
work is to provide a detailed statistical description of the internal dynamics of single agents 
in the Naming Game, studying their relation with the collective behavior of the model in 
its different dynamical regimes. 

As many other models of social interaction, the Naming Game is a non-equilibrium model 
in which the system eventually reaches a stationary state. The dynamical evolution of these 
systems is usually characterized by a temporal region in which the system reorganizes itself 
followed by the sudden onset of a very fast convergence process induced by a symmetry 
breaking event. The Naming Game presents this type of dynamics when the agents are 
embedded in a mean-field like topology, i.e. a complete graph, and complex networks with 
small-world property, that are undoubtedly the most realistic cases for models of social 
interaction. 

With respect to usual global quantities, studied in Refs. , the analysis of single 
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FIG. 1: Global behavior of the Naming Game on different topologies. The complete graph (mean- 
field case) is compared to Erdds Renyi and Barabasi-Albert graphs, both with average degree 
(k) = 10. In all cases, after an initial spreading of the different states, the dynamics goes through 
a period in which different states (whose total number is Nd(t)) are exchanged among the agents. 
Thus, the total number of states, N w (t), grows till a maximum and then start decreasing due to 
successful interactions which eventually lead the system to converge (Nd(t) = 1, N w (t) = N). 
Finite connectivity allows for a faster initial growth in the success rate, S(t). However, small- world 
properties give rise to the same exponential convergence observed in the fully connected graph. 
Data refers to populations of N = 1000 agents. 

agents activity allows to investigate the connection between the learning process of the 
agents [rsj] and the topological properties of the system. Interestingly, it turns out that, far 
from the convergence process, the shape of the distribution of the number of states stored 
by an agent, i.e. its memory size, depends on purely topological properties of the system 
(i.e. the first two moments (k) and (k 2 ) of the degree distribution). In particular, we 
show analytically, by means of a master equation approach, that homogeneous graphs yield 
exponential distributions, while heterogeneous networks, characterized by large fluctuations 
of the agents degree, give rise to half-normal distributions. 

During the convergence process, on the other hand, the master equation approach is still 
appropriate to describe agents internal dynamics, but with qualitatively different results. 
All these systems tend to develop a power-law memory-size distribution, that is a signature 
of the convergence process, but it actually emerges only in the case of the complete graph 




(called 'mean-field' case). In other topologies, the cut-off sets in too early for the power-law 
to be observed. 

Therefore, the analytical and numerical study of the memory-size distributions provides 
deep insights on the influence of the topology in the dynamics of the Naming Game. More- 
over, the new findings are complementary to those already known from the analysis of global 
observables, and allow for a deeper understanding of the observed phenomena. 

The paper is organized as follows. The next section is devoted to the description of 
the Naming Game model. Section IIHI contains the main numerical results concerning the 
internal dynamics of individual agents in the Naming Game. In section IIV[ the problem of 
determining agents internal dynamics is faced using a master equation approach. Section 
is devoted to illustrate in details some interesting cases. Conclusions on the relevance of the 
present work are reported in section IVII 



II. THE MODEL 

We consider the minimal model of Naming Game (NG) proposed in Ref. Q|. A population 
of N identical agents are placed on the vertices of a generic undirected network, while the 
edges identify the possible interactions between them. An agent disposes of an internal 
inventory, in which it can store an a priori unlimited number of states. As initial conditions 
we require all inventories to be empty. At each time step, a pair of neighboring agents is 
chosen randomly, one playing as "speaker" , the other as "hearer" , and negotiate according 
to the following rules: 

• the speaker selects randomly one of its states and conveys it to the hearer; 

• if the hearer's inventory contains such a state, the two agents update their inventories 
so as to keep only the state involved in the interaction (success); 

• otherwise, the hearer adds the state to those already stored in its inventory (failure). 
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ective behavior of the system on different networks has been largely studied in 
In particular, it turns out that essential quantities to describe the convergence 
process are the total number of states present in the system, N w (t), the number of different 
states, Nd(t), and the success rate, S(t), defined as the probability of a successful interaction 
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at a given time. In Figure curves relative to complete graph (mean-field), Erdos-Renyi 
(ER) homogeneous random graph and Barabasi-Albert (BA) heterogeneous network are 
reported (see Refs. ll|, ll2[ for reviews of the networks models). In the fully connected 



graph the process starts with an initial moderately fast (linear with time) spreading of states 
throughout the system followed by a longer period (0(A L5 )) in which states are exchanged 
among the agents. The total number of states then reaches a maximum and starts decreasing 
slowly till a point in which an super-exponential convergence leads the population to the 
adsorbing configuration in which all agents have the same unique state. On low-dimensional 
lattices and hierarchical structures, on the other hand, the model converges very slowly, 
and the reason is related to the formation of many different local clusters of agents with 
the same unique state, growing by means of coarsening dynamics rJ. Finally, in the case 
of networks with finite average connectivity (sparse graphs), the initial dynamics is similar 
to that registered in low-dimensional regular structures, but the small-world property (i.e. 
average inter- vertex distance scaling as log N and presence of shortcuts connecting otherwise 
distant regions) boosts up the convergence process restoring the fast mean-field like cascade 
effect leading the system towards the global agreement. 

The present work, however, is addressed to study this model from a different and comple- 
mentary point of view, focusing on the activity patterns of single agents. The next section 
is devoted to show some numerical results on the individual dynamics. 

Before proceeding, a remark is in order. In heterogeneous networks, highly connected 
nodes (hubs) play a different role in the dynamics compared to low degree nodes. Indeed, 
as already pointed out for the Voter model ^J, the asymmetry of the NG interaction 
rules becomes relevant when the degree distribution of the network, p^, has long tails. 
When selecting the two interacting agents, the first node is thus chosen with probability 
Pk, while the hearer is chosen with probability = kpk/(k). Then the high-degree nodes 
are preferentially chosen as hearers, if the first extracted node is the speaker. We adopt 
this selection criterion, called direct Naming Game, since it fits realistic speaker-hearer 
interactions naturally. However other strategies are possible: one could first select the 
hearer and then the speaker (reverse NG), or more neutrally, an edge could be selected 
and the role of speaker and hearer assigned with equal probability among the two nodes 
(neutral NG). For further details on the consequences of pairs selection rules see 
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III. NUMERICAL RESULTS ON AGENTS ACTIVITY 



In this section, we study numerically the activity of an agent focusing on the dynamics of 
its memory or inventory size, i.e. the number of states n t stored in the inventory of a node 
at the time t. In particular, the present analysis is conceived for populations on which we 
cannot clearly identify a coarsening process leading to the nucleation and growth of clusters 
containing quiescent agents (e.g. complete graph, homogeneous and heterogeneous random 
graphs, high-dimensional lattices, etc.] 



ete graph, 



Complex networks represent typical examples of such topological structures. In other 
topologies, such as in low-dimensional lattices, the agents internal activity is limited by the 
small number of words locally available. An example of the different activity patterns in 
different topologies is reported in Fig. Top panels show the different level of activity 
displayed by low and high degree nodes in a BA heterogeneous network. The hubs are more 
active, being preferentially chosen as hearers, and they may reach larger inventory sizes 
(memory). In homogeneous networks (bottom-left panel) all agents display approximately 
the same level of activity. In this case we reported an ER random graph with rather large 
average degree, so that the inventory may reach moderately large sizes. It is possible to verify 
with a magnification of the scales that the structure of the peaks is the same for all networks. 
The only topology displaying clearly different results is the regular one-dimensional lattice 
(bottom -rig ht panel) , in which the inventory size does not exceeds 2 because of the coarsening 
process [13]. 

A quantity that clearly points out the statistical differences in the activity of the nodes 
depending on both their degree and the topological structure of the network is the probability 
distribution V n (k\t) that a node of degree k has a number n of states in the inventory at the 
time t. The distribution is computed averaging over the class of nodes of given degree k at 
a fixed time t. Fig. |3] displays typical inventory size distributions for the Naming Game on 
complex networks computed in the reorganization region that precedes the convergence. The 
top panel of Fig. El reports V n (k\t) for the case of highly connected nodes in a heterogeneous 
network (the Barabasi-Albert network), whereas the bottom panel shows the same data for 
nodes of typical degree in a homogeneous network (the Erdos-Renyi random graph). From 
the comparison of the curves for different temporal steps (in the reorganization region), 
it turns out that in both cases the functional form of the distribution does not change 
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FIG. 2: Examples of temporal series of the number of states at a given node. Top) Series from 
a Barabasi-Albert (BA) network with N = 10 4 nodes and average degree (k) = 10, for nodes of 
high degree (e.g. k = 414) and low degree (e.g. k = 10). Bottom) Series for nodes in Erdos-Renyi 
random graph (N = 10 4 , (k) = 50) and in a one-dimensional ring {k = 2). 



considerably in time; the time t enters in the distributions as a simple parameter governing 
their amplitude and the position of the cut-off. 

Moreover, in homogeneous networks the shape of the distribution does not actually de- 
pend on the degree of the node, since all nodes have degree approximately equal to the 
average degree (k). In the heterogeneous networks a deep difference exists between the be- 
havior of low and high degree nodes. Low degree nodes have no room to reach high values 
of n, thus their distribution has a very rapid decay (data not shown) ; for high degree nodes, 
on the contrary, the distribution extends for more than one decade and its form is much 
clearer. 

Apart from the behavior of low degree nodes, it is clear that the functional form of the 
distribution V n (k\t) is different in homogeneous and heterogeneous networks. Homogeneous 
networks are characterized by exponential distributions, while high degree nodes in het- 
erogeneous networks present faster decaying distributions, that are well approximated by 
half-normal distributions (i.e. with Gauss-like shape). 

Both cases of homogeneous and heterogeneous networks appear different from that of 
the mean- field model studied in Ref. in which the agents are placed on the vertices of 
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FIG. 3: Parametric dependence on time of the distribution of the number of states: the time has the 
effect of deforming the shape of the distributions, but does not change their functional description. 
Top) BA graph of N = 10 4 nodes with (k) = 10. Only the set of nodes with k > 150 (hubs) is 
monitored. Histograms come from measurements at different times t± and £2 with ti — t\ = 5.10 5 
time-steps. Bottom) ER graph of N = 10 4 nodes and (k) = 10. Measures refer to to the set of 
nodes with k > 70. t2 — t\ = 4.10 5 time-steps. 

a complete graph and, during the reorganization, the inventory size distribution is given 
by the superposition of an exponential and a delta function peaked around n ~ yfN. The 
reason of these differences will be elucidated in the next sections by means of an analytical 
approach to the problem. 

In contrast with the previous reorganization region, the main global quantities describing 
the dynamics accelerate when the system is close to the convergence: N w (t) converges to N, 
while N<i(t) and S(t) go to 1, all with a super-exponentially fast process. Nevertheless, even 
in this region, the temporal scale of the global dynamics is much slower than that of agents 
activity, thus the fixed-time inventory size distribution V n (k\t) is still a significant measure 
of the local activity. In this case, the mean-field presents a more interesting phenomenology 
compared to sparse complex networks. Fig.0]shows that, near the convergence, the complete 
graph develops a power-law inventory size distribution, with an exponential cut-off at n ~ 
y/~N. Approaching the final consensus state the slope of the power-law becomes steeper and 
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FIG. 4: Inventory size distribution for the Naming Game on the complete graph during the con- 
vergence process. At the beginning the peak at n ~ y/~N gives way to a power-law, with exponent 
approximately —1, that rapidly becomes more and more steep at low values of n. The numerical 
data are obtained from a single run of the Naming Game on a complete graph of N = 10 4 nodes, 
monitoring the whole temporal region of convergence. Note that we report single run experiments 

n 

since the temporal fluctuations of the convergence process are rather large (see Ref. |7(), so that 
averaging over many runs may alter the real value of the power-law exponent. 

the cut-off moves backwards to 1. 

Similar power-law behaviors are not observed in any other topology even if it should be 
expected on homogeneous random graphs that, in the limit of large average connectivity, 
tend to the complete graph. Numerical simulations instead show that, in the region of 
convergence, both homogeneous and heterogeneous complex networks (such as the ER model 
and the BA model) present an exponential distribution of the inventory size (data not 
shown) . 

The numerical results reported in this section point out that the microscopic agents 
activity is closely related with the global dynamics and with the topological properties of 
the system. In the next section, we will show that, even if the dynamics of the number of 
states exhibited by a node is very complicated, mapping it on a jump process allows for some 
more rigorous results that give reason of the behaviors found in the numerical simulations. 
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IV. MASTER EQUATION APPROACH TO AGENTS INTERNAL DYNAMICS 



The jump process observed in the previous section and its statistics can be described 
using a master equation for the probability V n (k, t) that an agent of degree k has inventory 
size n at time t. Formally, it reads 

V n {k, t + 1)- V n (k, t)= W k (n - 1 -> n\t)V n ^(k, t) - W k (n + l\t)V n (k, t) (1) 

-W k {n^l\t)V n {k,t) N d {t)>n>l 
Vi(k,t + 1) - Vi(k,t) = Ef^WkU -> l\t)Vj(k,t) - W*(l -> 2\t)V 1 {k,t) , 

where A^(t) is the maximum number of different states present in the system at time £ 
and V n (k,t) depends a priori explicitly on the time. Note that this equation describes the 
average temporal behavior of a class of agents with the same degree k. 
In order to get an expression for the transition rates, we call Ck(t) the number of different 
words that are accessible to a node (of degree k) at time t, i.e. that are present in the 
neighborhood of the node. In the case of the complete graph, Ck(t) = C(t) = Nd(t). The 
small- world property characterizing many complex networks ensures that the quantity Ck(t) 
does not actually depend on k, since nodes with very different degree have access to the same 
set of different states (or words). Furthermore, the largest part of the states present in the 
system are accessible to all nodes. In small-world topologies, indeed, there is an initial 
spreading of words throughout the network that destroys local correlations. Consequently, 
we will safely approximate Ck(t) with C(t) and we can expect C(t) < Nd(t) and proportional 
to it. The case of low- dimensional lattices is different since states can spread only locally, 
causing strong correlations between the inventories 

According to the numerical results exposed in section ITTT1 the behavior of V n (k,t) allows 
to separate the evolution of the system in two regimes: a reorganization region extending 
from the maximum of N w (t) to the beginning of the convergence process, and a convergence 
region, involving the cascade process that leads the system to the final consensus state. In 
addition, V n (k,t) assumes different shapes for different topologies. 

Interestingly, in both regions, the temporal dependence of the distribution turns out to 
be only parametric, i.e. it has the only effect of deforming the shape during the evolution. 
In other words, the actual distribution should be well approximated by a quasi-stationary 
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solution V n (k\t) of the master equation, only parametrically depending on the time. 
This means that the master equation can be solved by means of an adiabatic approximation, 
a method that is commonly used in the study of out-of-equilibrium systems with different 
time scales for the dynamics l^ . 

In order to prove the validity of the adiabatic approximation, we need the expressions of 
the transition rates W4(a — > b\t) from the inventory size a to b at time t, in both dynamical 
regimes and for different topologies. 

A. Transition rates in the reorganization region 

In a general context, the expressions of the transition rates can be derived from the 
probability of a successful interaction, given by 

r , \S n H\ . . 

Frob {success} = , (2) 

where l^ni? | is the size of the intersection set between the inventories of the speaker and the 
hearer, and rig is the inventory size of the speaker. Note that expression in Eq. |21 holds for 
every choice of the speaker-hearer pair, and its average over the population corresponds to 
the success rate S(t). In the reorganization region, the intersection \SC\H\ is on average close 
to zero and all states have approximately the same probability of appearing in the inventory 
of the speaker, justifying the assumption of uncorrelation of the inventories in all topologies 
with small-world property. From this assumption it turns out that the intersection is well 
expressed by \SnH\ ~ nsnu/N^t) (where ns and n# are the inventory sizes of the speaker 
and the hearer). Indeed, the fraction of all accessible states that are present in the inventory 
of the speaker is ns/N^t); i.e. in each slot of the hearer's inventory there is a probability 
ns/Nd(t) of finding a given state. Since the average number of common states is given by 
the product of such probability and the hearer's inventory size the result for \S (1 H\ 
follows. 

The expressions of the transition rates are straightforward from the probability of a 
successful negotiation, — n^/Nd- Considering both the probabilities for the agent 

playing as hearer and speaker, the transition rate W£(n — > l|t) reads 

no (3) 
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FIG. 5: Probability of winning and loosing (only the term causing an increase of the number of 
words) for BA and ER models. Both with N = 5000 nodes and k ~ 200 (for a BA with (k) = 10) 
and k ~ 70 (for a ER with (k) = 50). Data were obtained averaging over several runs (3.10 4 ) the 
probability of successful or unsuccessful interactions after t = 5.10 5 time-steps from the beginning 
of the process. In fact, the time has also in this case only a parametric influence on the observed 
curves. 

where the average inventory size (n) t comes from the mean-field hypothesis for the neighbor- 
ing sites of a node playing as speaker, that is actually correct in all small-world topologies, 
and pk and qt are the probabilities of playing as speaker and as hearer respectively. The 
index r in W[ is used to indicate that these transition rate are correct in the reorganization 
region. The inventory size may increase only when the agent plays as hearer, i.e. 

n 



W k (n -+ n + l\t) ~q k 1- 



C(t) 



(4) 



In order to verify the above expressions for some specific cases, we have computed nu- 
merically the quantities W£(n — ► n + l|i) and W£(n — > l\t), in the case of a BA network of 
N = 5 ■ 10 3 nodes and (k) = 10 (top panel in Fig. [SJ) and for an ER model with N = 5 • 10 3 
nodes and (k) = 50 (bottom panel in Fig. |SJ). 

For heterogeneous networks, the numerical W£(n — > l|t) clearly show a linear growth of 



12 



the quantity with n, in agreement with Eq. |3J while the approximately constant behavior 
of WKn — > n + with n can be fitted with an expression of the form Eq. 0]only for very 
small values of n/C(t). On the other hand, Fig. |5] (bottom) points out that in the case 
of homogeneous networks, in which all nodes have approximately the same behavior, both 
quantities are almost independent of n. The different behaviors of the transition rates are 
responsible of the different shape of the probability distribution V n (k\t). 

B. Transition rates during the convergence process 

When the convergence process begins, the temporal behavior of all global quantities 
accelerates, and the expression of the success probability changes considerably. In all small- 
world topologies, the convergence is reached by means of a sort of cascade process, triggered 
by a symmetry breaking event in the space of the states (words, etc.) Q. The state 
involved in the symmetry breaking starts to win, becoming more and more popular among 
the inventories. At the end of the process, when the global consensus is reached, this is the 
only surviving state. 

According to this analysis, as the system is close to the convergence, most of the successful 
interactions involves the most popular state, while positive negotiations involving different 
states rapidly disappear. The statistical behavior of the quantity depends now only 

on the properties of the most popular word. The average size of the intersection set IS'fl.f/'l 
is well expressed by the probability afc(t) of finding the most popular state (or word) in 
both the inventories. During the convergence process, otk{t) is close to one. With this 
approximation we are neglecting the successful interactions due to less popular states, that 
we will show to have an effect for the dynamics on the complete graph (see section IV C|) . 
According with this argument, the transition rates assume the following form, 



where the index c is used to distinguish the expression of the transition rates during the 
convergence region from that of the reorganization regime. 




(5) 



(6) 
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C. Validation of the adiabatic approximation 

In both the reorganization and the convergence regions, the validity of the adiabatic 
approximation can be proved computing the characteristic relaxation time of the non- 
equilibrium process described by the master equation in Eq.|2]with transition rates of Eqs.OHU 
or Eqs. EE1 Given the (continuous, for simplicity) master equation d t V(t) = — WP(i), the 
relaxation time r is defined as the inverse of the real part of the smallest non-zero eigenvalue 
Ai of the transition matrix W. The explicit diagonalization of the Markov transition matrix 
for a finite system may be demanding, but the order of magnitude of r is easy to compute. 
We first note that W = PfcW in both cases. 

In the reorganization region, when C(t) ^> 1, the real parts of the eigenvalues of W are 
Oikj (k)), thus Ai oc q k , and the time necessary to reach the stationary state is r ~ 0(l/qk)- 
The argument holds even close to the consensus state, where C(t), (n) t , and a^if) are of 
order 1, since the smallest non-zero eigenvalue is still oc qk- Note that, in all complex net- 
works qk > 1/N, thus r < N. The time-dependent quantities involved in the expressions 
of the transition rates, such as (n) t and C(t) and «&(£), vary on a slower timescale (the 
characteristic timescale of the global system is t/N), justifying the adiabatic approximation. 



D. General expression of the adiabatic solution in the two dynamical regions 



Mathematically, the adiabatic approximation consists in setting to zero the temporal 
derivative of the inventory size distribution, and looking at the stationary solution V n {k\t), 
with parametric dependence on the time, that we call adiabatic solution. We compute 
the general adiabatic solution of the master equation in the two regions, while the most 
interesting cases are reported separately in the next section. 

Let us first consider a general complex network in the reorganization region. Plugging 
the expressions of the transition rates W r k {n — > n + l\t) and W£(n — > l\t) into the stationary 
form of the master equation (Eq. EJ), we get the following recursion relation, 



Vn(k\t) 



Qk 


i n— 1 
C(t)_ 




Qk 


1 ™_ 

°(*)_ 


+ % k C{t) + P k C(t) 



V n -l{k\t) ■ 



(7) 
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Then, introducing q k = kpk/{k) = b(k)p k and Eq. [7|can be rewritten as 



Vn(k\t) 



Since C 1, we can write 1 — 



V n -i(k\t) . 



(8) 



e c w , thus solving the recurrence relation, 

n(n — 1) 



V n {k\t) ~ s{k,t) n - x e 



2C(t) 



Vi(k\t) 



(9) 



with s(k,t) = b(k)/ (b(k) + c^j- The normalization relation gives Vi(k\t). The controlling 
parameter of the curve is s(k,t), that allows to tune the decay of the distribution between 
an exponential and a Gaussian-like tail. A change of variable s(k,t) = 1 — e(k,t) (with 
e(M) ~~ b(k)C(t) ) ma kes evident that s(k,t) n ~ e e ( fc '*) n ; therefore the curve has the behavior 



/; ,\ n(n — 1) 

P n (fc|t) oc e - e(fc>t)n -^T 



(10) 



The linear term dominates when (n) t ^> 6(/c), i.e. in homogeneous topologies, while the 
quadratic term governs the shape of the distribution for the high-degree nodes in heteroge- 
neous networks {{n) t -C b(k)). This result is very interesting since it shows that heterogeneity 
is a necessary condition for agents to show a super-exponential decay in the inventory size 
distribution. 

When we are in the convergence region, on the other hand, to get the form of the memory 
size distribution we must insert the Eqs. into the stationary version of Eq. El 



dV n {k\t) 
dt 



= q k 1 



^) -Pn-i(k\t) - q k (l - ^ ) V n (k\t) 



Pk- 



(n)t 



71 



+ qk- 



(n)t 



(11) 



V n (k\t) 



We get the following recursive relation, 



Vn(k\t) 



(n)t 



6(Jfc) n 



Pn-l(fc|*) 



(12) 



in which 6(/c) = k/(k). The general solution is of the form 



P„(A;|t) oc n 6 W e <"> 



(13) 



showing that near the convergence, the inventory size distribution may develop a power-law 
structure. Nevertheless, in the section IIII1 we stated that from numerical data there is no 
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evidence of power-law behaviors on complex networks. This can be explained looking at the 
terms of Eq. in homogeneous networks, the power- law has exponent close to 1 (since both 
Oik(t) and b(k) are of order 1), but the cut-off imposed by the exponential distribution sets 
in at very low n, preventing the underlying power-law to be observed. The same argument 
holds for low-degree nodes in heterogeneous networks, but high-degree nodes should present 
sufficiently large inventories to see the power- law. However, in this case b(k) 3> 1, thus the 
exponent of the power-law is too small to be observed. 

The only case in which we are able to observe a power-law inventory size distribution is that 
of the complete graph, that presents some peculiarities and will be discussed separately in 
the next section. 

V. ADIABATIC SOLUTION FOR SOME INTERESTING CASES 

In this section, we study more in detail the effects of the topology on the adiabatic 
solution of the master equation making explicit calculations in three interesting cases: in 
the reorganization region, we consider the activity statistics of generic nodes in homogeneous 
random graphs and of hubs in heterogeneous scale-free networks; in the convergence region, 
we focus on the purely mean-field behavior of agents placed on a complete graph. 

A. The case of homogeneous networks 

As revealed by simulations reported in Fig. 03 (bottom) the transition rates for homoge- 
neous networks in the reorganization region are almost independent of the number of states 
in the inventory. In homogeneous networks — b(k)pk, with b(k) ~ 0(1), and the nodes 
are in general equivalent, thus the number of states is approximately the same for every 
node, i.e. n ~ (n)t- The approximated expressions of the transition rates for a node of 
typical degree k = (k) are 





l\t) « Pk (n) t (l + b(k))/C(t) « 2 Pk (n) t /C(t) 



(14) 
(15) 
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Such approximations are in agreement with the data reported in Fig. 0-bottom. 
The adiabatic condition for the master equation becomes 

0= V n -x{{k)\t) — V n ((k)\t) — {n) t -^V n ({k)\t) n>l 

0= E7 =2 4)(^(W|t)-n((A:)|t) • (16) 

The solution by recursion is very simple, 

V n ((k)\t) * (1 - 6)9 n -\ 9=—^;. (17) 

+ C(t) 

Using the expansion of logarithm log(l — e) ~ — e, with e = 1 — 9 ~ 2{n) t /C(t), the previous 
formula gives the following exponential decay for the distribution of the number of states, 

V n ({k)\t)^^e-^ n . (18) 

The exponential decay is in agreement with the numerical data. Knowing the complete 
form of the distribution (i.e. with the correct normalization prefactor), we can also roughly 
estimate (n)t and C(t), at fixed time t, from a self-consistent relation for (n) t , From Eq. fTHl 
we compute the approximate average value of (n) t , i.e. 

/oo 
nP n ((k)\t)dn , (19) 

and we get the self-consistent expression 

C(t) \ L 2(n)A _2hk 



^^{m){ 1+ m) e ~^- (20) 

Now, introducing in Eq. [^UJthe numerical value of (n) t /C(t), it is possible to verify that the 
orders of magnitude of both (n) t ~ O(10) and C(t) ~ (9(10 2 ) are in agreement with their 
numerical estimates. 



B. High-degree nodes in heterogeneous networks 

Now we pass to describe the dynamics of the hubs in heterogeneous networks in the 
reorganization region of the system. In a direct Naming Game, a hub is preferentially 
chosen as hearer, by a factor b(k) = k/ (k) 3> 1, then in the transition rates we can neglect 
the terms associated with the speaker. We consider the following approximated expressions 

Tl 

W k {n - ~ q k — t y , (21) 
W r k (n n + l\t) ~ q k (l - -^-) ~ q k , (22) 



C(t) 
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in which the last approximation is justified by the fact that, in general, n/C(t) <C 1. Inserting 
realistic values of q k and C(t), the Eqs. l2"iTl2*2l are in agreement with the behaviors coming 
from the fit of the corresponding curve in Fig. (top). 
We can easily compute the adiabatic solution V n (k\t) from Eq. |2] 

= q k V n -i{k\t) - [q k + Qk-^j V n (k\t) , (23) 

and we find recursively 

Mm = c$^-ii<W = (cmJlS'^-^ W) (24) 

Now, from the closure relation ^nLi^M*) = 1 we get the expression of Vi(k\t), and the 
final form for V n (k\t) becomes 



,n-l 



r(c(t) + 1) 



(26) 



c(ty 

L7(C(0 + 1,C(*)). 

where 7(0, x) is the lower incomplete Gamma function. The functional form of the sta- 
tionary distribution is complicated, but exploiting Stirling approximations for Gamma 
functions we can easily write it into a much simpler form. Indeed, using the expression 
r(x) ~ y/2ne~ x x x ~ 1 ^' 2 and the representation via Kummer hypergeometric functions for the 
incomplete Gamma function 7(0, x), we find that 

T(x + 1) 

lim — - = const ~ 2 , (27) 

x-h-oo 7(3; + 1, x) 

and this value is correct in the range of x = C(t) 3> 1. Finally, using the asymptotic series 
expansion of T(x + n + 1) for large x, we get an expression that can be formally written as 



T{x + n + l) « V2^e~ x x x+n+1/2 x {0{1) + Q[0{{n + lf^x' 1 + Q[0{{n + l) 4 )}x- 2 + . . .} , 

(28) 

in which Q[0((n + 1)')] is a polynomial in (n + 1) of maximum degree I. Now, we can do 
the resummation of the series keeping at each order k in x only the highest term in the 
polynomial in (n + 1), whose coefficient is 2~ h /k\, 

00 ~k( 1 1 \2fc 

r( x + „ + 1) « y^e"*^* 1 / 2 ^ X j = v ^e- a:+ ( n+1 ) 2 / 2a: x :r+n+1 / 2 . (29) 

fe=0 
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Putting together all the ingredients, we find that a good approximation of the distribution 
of the number of words is given by (the half-Normal distribution) 

T « m * \Hr^ ■ (30) 

Fitting numerical results in Fig. |5] (top) with this expression provides values for C(t) ~ 
£>(10 2 ), showing that, as expected, on the BA model C(t) < N d (t) ~ C(10 2 10 3 ). 



C. Power-laws on the complete graph 

The last interesting case consists in studying the inventory size distribution for agents on 
the complete graph. In the reorganization region, the mean-field dynamics is characterized 
by a large fraction of agents with 0(yN) states in their inventories and another smaller 
fraction with exponentially distributed inventory sizes. The existence of a peak at 0{yN) 
comes from the initial accumulation process (see Ref. Q), while the exponential part of the 
distribution is produced during the following reorganization regime. Since the most of the 
agents have 0(\/N) states and the intersection between inventories is close to zero, we can 
write the following transition rates 

W fc r (n^l|t)«|--L (31) 



W fc >-n + l|t)^l(l--L) (32) 



With the usual recurrence relation we compute the following adiabatic solution, 

V n {k\t) oc f(t)S(n -VN) + (1- f(t)) e'Vw n , (33) 



with f(t) is the fraction of agents around y N that tends to zero the convergence 

The interesting region is however the last one, during the convergence process, in which 
the inventory size distribution of the mean-field system develops a power-law structure. In 
Eq. we have shown that the expected distribution in the convergence region presents a 
power-law, that in the particular case of the complete graph should have an exponent close 
to 1 (since «&(£) ~ 1). Nonetheless, Fig. H] reveals that the slope —1 is correct only at the 
beginning of the convergence process, while later the slope seems to increase, developing 
a bump in the range of small inventory sizes. Starting from the previous remark on the 
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mixed distribution emerging in the reorganization region, we explain how the alteration of 
the power-law is due to the superposition of an exponential distribution. 
During the convergence process, the agents having access to the most popular state behaves 
following the transition rates in Eqs. EE and their activity is at the origin of the power-law 
in V n (k\t). The other agents, that have no access to the most popular state maintain an 
inventory of size about yN and fall to 1 if they get a successful interaction. In other words, 
they keep on playing as in the reorganization region, generating an exponential distribution 
of the inventory sizes. Even if the fraction of these agents decreases in time, the superposition 
of the exponential on the power-law has the immediate effect of increasing the slope of the 
power-law at low n. 

In summary, we have provided an explanation of the behavior of the activity patterns of 
the Naming Game on the complete graph, pointing out some fundamental differences with 
respect to generic complex networks. 



VI. CONCLUSIONS 



We have studied the microscopic activity patterns in a population of agents playing the 
Naming Game proposed in Ref. Q|. Previous work pointed out that the non-equilibrium 
dynamical behavior of the model presents very different features depending on the underlying 
topological properties of the systemj^, 0, llO]. The analysis, however, were focused on the 
behavior of global quantities, while in the present work we have investigated the microscopic 
activity patterns of single agents. Indeed, by means of numerical simulations and analytical 
approaches, we have shown that the negotiation process between agents is at the origin of 
a very rich internal activity in terms of variations of the inventory size. More precisely, our 
analysis has focused on the instantaneous activity statistics described by the distribution 
V n (k\t) that an agent of degree k has an inventory of size n at time t. We have been able 
to explain its behavior in function of both the global temporal evolution and the underlying 
topology of the system. 

Apart from an initial transient, the dynamics of the Naming Game can be split in two 
temporal regions, namely the reorganization part and the convergence part. Fig. El sum- 
marizes our findings, showing the microscopic activity statistics in function of the first two 
moments of the degree distribution P(k), which turn out to be essential features of complex 
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FIG. 6: Phase plane like pictures in which the topological affects on the microscopic activity of the 
Naming Game are summarized. Left figure displays the situation in the reorganization region, in 
which the major effect is due to the increase of the degree fluctuations (the memory size distribution 
passes from an exponential to a half-normal distribution. In the right panel, we show the same 
picture for the convergence region, in which the final cascade process of convergence porduces a 
power-law like memory size distribution. Such a distribution is however visible only in the purely 
mean-field case, while on generic complex networks is covered up by exponential terms. The region 
at both large average degree and fluctuations is difficult to be explored, but should correspond to 
mixed distributions in which all previously classified behaviors may be observed. 

networks affecting the dynamics of the V n (k\t). In the left panel of Fig. |H]we sketch the 
relation between topology and single agent activity in the reorganization region. Increasing 
the heterogeneity of the nodes the V n (k\t) shifts from an exponential to a super-exponential 
(half normal) regime. Increasing (k) while preserving the homogeneity of the nodes, on 
the other hand, leads to a superposition of an exponential and a delta at \^N. A class of 
distributions mixing up all these features is observed for networks with diverging average 
degree and fluctuations (top-right corner of the plane). A similar summary describes the 
effect of the topology in the convergence region (Fig. right panel): increasing the average 
degree, the distribution moves from exponential to a superposition of an exponential and 
a power-law, while larger fluctuations destroy the power-law leaving only an exponential 
distribution. 

In general, the influence of topological properties of complex networks on the dynamical 
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properties of processes taking place on them is the object of a vast interest in statistical 
physics community. However, only global properties are usually considered. Here, we have 
focused on the internal dynamics of single agents, and we have found results providing ex- 
planation for the strong converging property of the corresponding global dynamics. Indeed, 
one of the most interesting aspects of the Naming Game is exactly that the number of states 
an agent can store is not fixed a priori and the update rule involves a memory-based nego- 
tiation process. This is a relevant difference with most of the well known models in various 
fields of statistical mechanics or opinion dynamics, such as the voter or the Axelrod models, 
and we have investigated its deep consequences on the global behavior of the system. 

A last remark concerns the comparison with usual statistical mechanics models. In this 
regard, it is useful to shift our perspective and look at the waiting time between successive 
decision events. In the present case, a decision event corresponds to a successful interaction, 
so that the waiting time is directly proportional to the inventory size. In the non-equilibrium 
glauber dynamics, for instance, a decision event is commonly associated to a spin flip. The 
corresponding waiting time is exponentially distributed during the dynamics (poissonian dy- 
namics), but close to the convergence (to the ferromagnetic state) the waiting time between 
two flips may diverge, and its distribution assumes a power-law shape. As we have shown, a 
similar behavior is observed and proved for the inventory size distribution in the mean-field 
Naming Game. The inventory size statistics in the Naming Game can be thus compared to 
waiting time statistics in other models. According to our analysis, it should be interesting 
to further investigate the relation between topology and individual waiting time statistics 
in other models of collective dynamics presenting similar non-poissonian individual activity. 
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